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Abstract 

f^J • In this paper, we study the stability of queues with impatient cus- 

tomers. Under general stationary ergodic assumptions, we first provide 
, some conditions for such a queue to be regenerative (i.e. to empty a.s. 

• an infinite number of times). In the particular case of a single server op- 

erating in First in, First out, we prove the existence (in some cases, on 
. an enlarged probability space) of a stationary workload. This is done by 

i i ' studying a non-monotonic stochastic recursion under the Palm settings, 

and by stochastic comparison of stochastic recursions. 
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ON 1 

O ' 1 Introduction 

: 

In this paper, we address the question of stability for queueing systems with 
J> \ impatient customers: the customers agree to wait for their service only during 

■ a limited period of time. They are discarded from the system provided that 

rS \ their patience ends before they could reach the service booth. Such models 

are particularly adequate to describe operating systems under sharp delay re- 
quirements: multimedia and time sensitive telecommunication and computer 
networks, on-line audio/video traffic flows, call centres or supply chains. 

We first give conditions of regenerativity, i.e., for the state to be recurrent 
for the congestion process of the system. Then, we construct explicitly a sta- 
tionary state for these systems in the particular case of a single server obeying 
the FIFO (First In, First Out) discipline. In that purpose, we study a stochasti- 
cally recursive sequence representing the workload seen by an arriving customer. 
This sequence and its dynamics have been thoroughly studied in the GI/GI/1 
case in [6] and [3]. In the G/G/l context, the workload sequence is driven 
by a non-monotonic recursive equation (eq. (9)), and hence a construction of 
Loynes' type, using a backwards recurrence scheme, is not possible. We thus use 
more recent and sophisticated techniques to construct a stationary workload: (i) 
Borovkov's theory of renovating events (see [8], [9], [4]) provides a sufficient con- 
dition for the existence and uniqueness of a finite stationary workload. Under 
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this condition, we can thus construct a stationary loss probability w, and pro- 
vide bounds for n (eq. (11)). (ii) We prove in whole generality the existence of 
a stationary workload on the enriched probability space f2 x K+ (where fi is the 
Palm probability space of reference) using Anantharam and Konstantopoulos' 
construction (see [1], [2]), which is based on tightness techniques. 

In both cases, we use the fact that the workload sequence is strongly domi- 
nated by another one, driven by a monotonic recursive equation (eq. (1)). Then 
the coupling of the dominating sequence with a unique stationary state (which 
is proven by Loynes' scheme) allows us to construct the stationary state of the 
dominated sequence. 

This paper is organized as follows. In section 2 we precise our basic assump- 
tions, and solve eq. (1) in the stationary ergodic framework, a result that will 
be used in the sequel. We present the queue with impatient customers in section 
3. In section 4, we provide conditions for the regenerativity of the system. In 
section 5, we construct a stationary workload in the FIFO case: we provide 
a sufficient condition for the existence and uniqueness in 5.1, and prove the 
existence of the stationary workload on an enriched probability space in 5.3. 

2 Preliminaries 

Consider a probability space (yi,T,P°), embedded with the measurable bijec- 
tive flow 9 (denote 6* _1 , its measurable inverse). Suppose that P° is stationary 
and ergodic under 6, i.e. for all 21 € F, P° [O' 1 ^] = P° [21] and all 21 that is 
6- invariant (i.e. such that 6*21 = 21) is of probability or 1. Note that according 
to these axioms, all ^-contracting event (such that P° [2l c H = 0) is 9- 

invariant. We denote for all n e N, 9 n = 60Q0...06 and 6~ n = 6' 1 oO' 1 o . . .oB' 1 , 
and say that two sequences of r.v. {X n } neN and {Y n } neN couple when there 
exists a P°-a.s. finite rank N such that they coincide for all n> N. We say that 
there is strong backwards coupling between {X n } neN and {Y o #™}„ eN provided 
that for some P -a.s. finite r, X n o 9~ n = Y for any n > r. 

Let a and (3 be two integrable K+- valued r.v., and denote for all n 6 Z, 
a n — a o 9 n and [3 n = j3 o 9 n . Let Z be an a.s. finite R+-valued r.v., and 
consider the following stochastically recursive sequence. 

r Y ( ? = z, 

\ Yf +1 = [max {y„ z , a n } - f3 n ] + for all n £ N. 

Then, {^rT} ne N ls a stationary version of this sequence provided that the r.v. 
Y is a solution to 

Yo9= [max {F, a} -/?]+. (1) 
We have the following result. 



Lemma 2.1 

There exists a unique P°-a.s. finite solution Y of (1), given by 
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Moreover, for all P°-a.s. finite and nonnegative r.v. Z, the sequence 
{Y^} ragN couples with {Y o#"} n6N , and there exists P°-a.s. an infinity 
of indices such that Y^ = if and only if 

P° [Y = 0} = 0. (3) 

Proof. Equation (1) can be handled by Loynes's construction (see [11], [5]) since 
the mapping [max{.,«} — (3] + o 9~ 1 is P°-a.s. continuous and nondecreasing. 
Hence Y classically reads as the P°-a.s. limit of Loynes's sequence, defined by 
\Y® o $~"} n(£N - It is routine to check from Birkhoff's ergodic theorem that Y 
is P°-a.s. finite. 

The coupling property follows from the fact that for all non-negative r.v. Z 
that is P°-a.s finite (and in particular, for Y = Z), 

{n-l 
Y* = Z - Pi > f or all n e N 
i=0 

which is of probability from Birkhoff's theorem. The last statement is a 
classical consequence of this coupling property under ergodic assumptions. □ 

3 The model 

Let us consider a queue with impatient customers until the beginning of service 
G/G/s/s+G (according to Barrer's notation, see [7]): on the probability space 
(ft, T, P), furnished with the measurable bijective flow (#t) teR under which P 
is stationary and ergodic, consider the ^-compatible point process TV, whose 
points {T n } n&z represent the arrivals of the customers {C„} ngZ , with the con- 
vention that To is the last arrival before time t = 0. The interarrivals, denoted 
for all n <E Z by £„ = T n+ \ — T n , hence form a stationary sequence of inte- 
grable r.v., and we denote £ := £0 = T\ — T . The process N is marked by the 
stationary sequence {c„} ngZ denoting the service durations requested by the 
customers, and the integrable r.v. a := erg is the service duration of customer 
Co . The customers enter a system with s non-idling servers and of infinite ca- 
pacity, and are impatient until the beginning of their service, in that they leave 
the system if they do not reach the service booth before a given deadline. In 
other words, customer C n agrees to wait in line for a given period of time, say 
D n (his initial patience) and if there is no server available during this period, he 
leaves the system forever at time T n + D n . {D n } neZ is a sequence of integrable 
and non-negative marks of {N t ) t>0 , and D :— Dq is the initial time credit of 
Co- We denote for all t G K, X t the number of customers in the system (or 
congestion) at t. The servers follow a non-preemptive service discipline. We 
therefore consider that a customer can not be eliminated anymore as soon as he 
enters the service booth, even if his deadline is reached during his service. 

Let us denote {ft, P°, 0) , the Palm probability space of N(cr,D), where 
9 := Qtx is the associated bijective flow. In particular, P° is stationary and 
ergodic under 9, and for all n £ Z, 

£„ = £ o 9 n , a n = ao9 n and D n = Do 9 n . 
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4 Regenerativity 



According to the assumptions made above, the total sojourn time of customer 
C n does not exceed D n + <r n , i.e. the sum of his initial patience and the time 
necessary for his service. On the other hand, it is at least equal to min {a n ,D n }, 
i.e. the time needed for him to be lost, or immediately served. Hence, provided 
that C n entered the system before t (T n < t) and even though he already left 
the system before t, his remaining maximal sojourn time at t (i.e. the remaining 
time before his latest possible departure time, if not already reached) is given by 
[a n + D n — (t — T n )] + , whereas his remaining minimal sojourn time at t (i.e. 
the remaining time before his earliest possible departure time, if not already 
reached) is given by [min {<r„, D n } — (i — T n )] + . Hence the largest remaining 
maximal sojourn time (LRMST for short) at t among all the customers entered 
before t is given by 

C t := nmx [a n + D n - (t - T n )] + 

n—l 

and the largest remaining minimal sojourn time (LRmST for short) at t, by 
M t ■= max [min {a ni D n } - (t - T n )} + . 

n=l 

The two processes (£t) t>0 and (Mt) t>0 evolve according to the following dy- 
namics: they decrease at unit rate between arrival times, and equal the initial 
maximal (resp. minimal) sojourn time of C n at his arrival time T„, provided 
that it is larger than the value of the process just before T n . In other words, for 
all n e Z and all t G [T n , T n+1 ) 

C t = [max{£ T „_, a n + D n } - (t - T n )} + , 

M t - [max {M Tn -, min {<r„, £>„}} - (t - T n )] + . 

Define for all finite nonnegative r.v. Y and Z and all n e N, := £t„- and 
:= A4t„-, the LRMST (resp. LRmST) just before the arrival of customer 
C n , provided that £t„- = Y (resp. M-t - = Z). The processes (^t) teR and 
{■M-t)teR nave rc H paths, hence we have the following recursive equations. 

Lf l+1 = [max { Lf , u n + D n } - £ n ] + , (4) 

Mf +1 - [max {Mf , min {<j„, D n }} - + . 

On (0,P°) the two latter equations are of type (1), hence Lemma 2.1 im- 
plies that for any Y and Z, {L^ } ngN and {M^ } ngN couple respectively with 
{L o n } neN and {M o n } n&] , where L and M are given by 



sup a-j + D_j 



M 



sup minia-j, D_j} ~Y^^- 



i=l 



(5) 

- 

(6) 
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In particular, for any initial conditions Y and Z, there are P-a.s. an infinity 
of indices such that — if and only if P° [L = 0] > 0, and an infinity of 
indices such that M% = if and only if P° [M = 0] > 0. Remarking now that 
for all initial conditions and alii > 0, 

{C t = 0} C {Xt = 0} C {M t = 0} , 

we obtain 



Theorem 4.1 

The G/G/s/s+G queue is regenerative (i.e. it empties P°-a.s. an 
infinite number of times) if 



sup a-j + D_j - £-* J < 



i=l 



>o, 



(7) 



and only if 



sup min{<7 _,,£>_.,} - V"^-i < 



i=l 



> 0. 



5 The FIFO case 

Let us now consider the special case, where there is one server obeying the FIFO 
(First in, first out) discipline. Denote for all t &R,Wt the workload submitted 
to the server at time t, i.e. the quantity of work he still has to achieve at this 
time, in time unit. The process (Wt) tgR has rcll paths, and we define for all n, 
W n = W T - . Its value at t equals the work brought by the customers arrived up 
to t, and who will eventually be served, since the other ones won't ever reach 
the server. Under the FIFO discipline, the served customers are those who 
find a workload less than their patience upon arrival. In-between arrival times, 
(Wt)teR decreases at unit rate. Hence, for all n G Z and t G [T n , T n+ \) 

Wt = [Wr n - + °nl{W Tn -<D n} - (t - T n )] + , 
whereas the workload sequence is driven by the recursive equation 

W n +1 = [W n + cr„l{W„<D„} - £n] + . (8) 

For all n G N and all finite non-negative r.v. Z, let Wjf be the workload 
seen by C n upon arrival, provided that Wq = Z. In addition to the previous 
result of regenerativity (Theorem 4.1), we investigate in this particular case the 
existence and uniqueness of a stationary version for the stochastic recursion (8) , 
i.e., of a finite r.v. W such that — W o 8 n , n G N, which implies that 

Wo0= [W + <j1 {w < d} - £] + . (9) 

The recursive equation (9) is not monotonic in the state variable, in which 
case a construction of Loynes's type becomes fruitless. In the following sections, 
we propose two methods to circumvent this difficulty. Let us first remark that 
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Lemma 5.1 

For all n G N, W° < L° n , P°-a.s.. 

Proof. For all n G N, on the event {W° < L°}, 

< [max(L° , cr„ + D n ) - £, n ] + ^-w«>D n + [max(L° , cr„ + D n ) - i n ] + ^-w^<D n 

= L° n+1 . (10) 

Since L% = VK °, by induction L° n > W° for all n G N, P°-a.s.. □ 
5.1 Sufficient condition 

In many examples, and even when monotonicity is not granted, a stochastic re- 
currence may admit a (possibly unique) stationary regime, provided that the se- 
quence 'regenerates' in a constant manner. This can be proved using Borovkov's 
theory of renovating events. 



Theorem 5.2 

If (7) holds, then (9) admits a unique finite solution W, which is such 
that M < W < L, P°-a.s., where L and M are defined respectively 
by (5) and (6). Moreover, for any finite initial condition Z, there is 
strong backwards coupling for {VF,f} ngN with {W o 6*™} ngN . 

Proof. Existence. From Lemma 5.1, for all n > 0, W° < lP n < = L o 9 n , 
P°-a.s.. Hence denoting 2l„, the event {L o 9 n = 0}, {%i} neN is a sequence of 
renovating events of length 1 for the sequence {W^} N since 2l„ C {W° = 0} 
for any n (see [5], p. 115, [8], [9]). Moreover, this sequence is stationary in the 
sense that for all n > 0, 2l„ = 6»" n 2l , where 2l = {L = 0} . Hence since (7) 
amounts to P° [2lo] > 0, this is from [5], Theorem 2.5.3., a sufficient condition 
for the existence of a solution to (9). 

Uniqueness. Let W be a solution of (9). Then, we have P° [W < D] > 0. 
Indeed, if W > D, P°-a.s. (which impies in particular that W o > 0, P°-a.s.), 
then W o9 = W-£, P°-a.s., which is absurd since E° [W - W o 9] = from the 
ergodic Lemma. On another hand, in view of the inequalities (10), {W < L} is 
clearly ^-contracting, whereas 

< P° [W < D] < P° [W o 8 < L o 6>] = P° [W < L] . 

Hence {W < L} is P°-almost sure, thus {W^} n£N = {Wo9 n } n&!i admits 
{21n}„ eN as a stationary sequence of renovating events of length 1. From [5], 
Cor. 2.5.1, P° [2lo] > implies the coupling property. 
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Finally, to prove that M < W, P°-a.s., remark that on {M < W}, 

M O 6 = [M - £] + lM>min{ CT „D} + [min{(T, D} - £] + lM<min{ CT ,.D} 
< [W - C] + lM>min{cr,_D} + [c — £,} + 1\V<D ^M<min{cr,D} 
+ [D — ^} + ^-W>D^-M<Ta.m{a,D} 
< [W + a 1\V<D - £] + lM>min{<T,D} + [W + U - £] + 1\V<D lM<min{cr,D} 
+ [W - ^] + lw>_DlM<min{cr,_D} 
= Wo ^lM>min{cr,r>} + W O ^lvT<i> lM<min{cr,£)} + W ° ^lw>L> lM<min{<r,_D} 

= 

Hence, {M < T'F} is ^-contracting. On another hand, we have 

P° [M < min{cr, D}} > 0, 

since M > min{er, D}, P°-a.s. would imply in particular that Mo9 > 0, P -a.s., 
and hence on a P°-almost sure event M o = M — £, which is absurd, again in 
view of the Ergodic Lemma. But on {M < min{er, D}}, 

M o 9 = [min{<7, D} - C]+ < [a - £} + 1 w <d + [D- £} + 1w>d <Wo6, 

hence 

< P° [M < min{cr, £>}] <P°[Mo9<Wo9]=P°[M<W], 
which concludes the proof. □ 

5.2 Some applications 

It is a very classical argument, that due to the FIFO discipline, the construc- 
tion of the stationary versions of some quantities of interest can be derived 
from that of the workload sequence. In particular, provided that (7) holds, 
one can construct a congestion process and a departure process (without dis- 
tinction between departures due to reneging and service completions) that are 
jointly compatible with the arrival process (N t ) tGR . Let us remark, that under 
condition (7) there exists also a stationary loss probability, denoted it, which is 
the probability that the waiting time proposed to a customer exceeds his initial 
patience, at equilibrium. This reads 

7T = P° [W > D] . 

With Theorem 5.2 in hands, we have in particular that 

P° [M > D] < n < P° [L > D] , (11) 
where L and M are given by (5) and (6), respectively. 

5.3 Weak stationarity 

In this section, condition (7) is no longer assumed to hold. We show how the 
techniques developed in [1] may allow us to construct a stationary workload 
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for the queue, on an enriched probability space. Again, this is done using the 
stochastic comparison with the LRMST sequence (Lemma 5.1). Let <fi{.} be 
the measurable random map from (R, 03(E)) into itself (we denote (f> G 97t(R)) 
defined by 

<£M M = [y + v{u)i{ V <D(u,)} - £M] + . 

We work on the enlarged probability space fl x R, on which we define the shift 

9((j,x) = {6lu,(I)(uj){x}) . 
We then have the following result. 



Theorem 5.3 

The stochastic recursion (9) admits a weak solution, that is, a 9- 
invariant probability P° on ft x R whose il-marginal is P°. Therefore, 
on (n x R) there exists a R x 97t(R)-valued r.v. (w, <f>j satisfying 



Wo0 



In particular, < ( W, <f> ) o9 n \ is stationary under P°, and \ 4> ° 9 n \ 
has the same distribution as {<f> o 9 n } neN . 



Proof. We aim to apply Theorem 1 of [1], whose corrected version is presented 
in [2]. Let us check that its hypotheses are met in our case. First, the sequence 
{L° }„ gN is tight since it converges weakly, which implies with Lemma 5.1 that 
{^n} n6 s i s tight, since for all e > 0, there exists M e such that for all n G N, 

P° [W° < M e ] > P° [L° n < M e ] > 1 
Define now on fl x R the random variables 



• £. 



W (lo , x) :— x , <p(u),x) := (f)(u)), 



and for all n G N, 



W n (uj,x) :=w(9 n (u,xj) . 
Remark that for all n G N, 21 G J 7 and 23 G 



0-" (21 x R) 



= p u 



) J [21 x R] = P° [21] 



and 
P°®<5 



fl- n (n x <b) 



-"(w^W) 



= P° <g> <5 ^(03) = P° [W° G 03] 



Hence, the probability distributions <^ P° <g> (5 o 0"" ^ onSJxM have O- 
marginal P° and R-marginals the distributions of {W,?} N i which form a tight 
sequence. The sequence < P° <g> 5o o 9~ n \ is thus tight. On another hand, 

I J nGN 

let us define for all pel*, 
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(i) V p = {(w, x) e x R; < z < + 2~p} 

(ii) for any (w,x) edxl, 



f p (u, x) = l x < D(u) + (-2 p x + 1 + 2 p D(ujj) l (w ,x)eVp, 



(iii) for any ef!xl, 



p (w, ar) = (Ouj, [x + f p {uj, x)a(uj) - • 



It is then easily checked, that for all p, V p is an open set, 9 = 9 p outside V p , and 
that p is continuous from ui x R into R. 
Let us now fix n,p > 1. We have 




- £ (p° ® <5o o §-*) (V p ) = - ]T P° [W^i o 0* e (D, £> + 2-')] . 




But in view of the coupling property of Lemma 2.1, on a P°-almost sure event 
<£, there exists — oo < r(w) < —1 such that for all i < r, o 0* = 0. In 

words, given Lo is null, there exists a.s. a finite instant r in the past, such that 
L T was null as well. Thus with Lemma 5.1, on (S, W^_ i o 6'' = for such an i, 
so that W a _ i o 9 l = W°_ T o T since events on [Tj,T T ] don't change the value of 
the workload at time zero whenever the system is empty at T T . Hence in view 
of the previous equality, 



-^(p^Joor*) (v p ) 

U i=0 

< P° [{3j e [r, -1] n Z; W ^ o &> e(D,D + 2~ p ) } n <£] . 



This implies, letting p tend to infinity in the previous inequality, that 



which is the last assumption of Theorem 1 of [1] (again, see [2] for the addi- 
tional assumptions). We can therefore apply this result, yielding that there 
exists a ^-invariant probability P° on O x R whose fi-marginal is P° . It is now 
straightforward that 



n-l 




W n (uj, x)=4> (9 n - 1 uj) o cf> (9 n - 2 uj) o ... o 4>(u){x}, 



<f>oO n (u),x) =4>o6 n (uj), 




satisfies on f2 x R the stochastic recursion 





□ 
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5.4 The loss system G/G/l/1 

The stationary workload for the loss system G/G/l/1 queue (there is no place 
in the buffer, so that each customer is served if and only if he finds an empty 
system upon arrival), which is constructed in [5], section 2.6, and on an enlarged 
probability space in [10] and [1] is a particular case of the study presented here, 
setting 

D(w) = 0, P°-a.s.. 

Replacing D by zero in the whole section 5 yields the results mentioned above. 
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